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Abstract — Noisy network coding, wliich elegantly combines the 
conventional compress-and-forward relaying strategy and ideas 
from network coding, has recently drawn much attention for 
its simplicity and optimality in achieving to within constant gap 
of the capacity of the multisource multicast Gaussian network. 
The constant-gap result, however, applies only to Gaussian relay 
networks with independent noises. This paper investigates the 
application of noisy network coding to networks with correlated 
noises. By focusing on a four-node Gaussian relay chain network 
with a particular noise correlation structure, it is shown that 
noisy network coding can no longer achieve to within constant 
gap to capacity with the choice of Gaussian inputs and Gaussian 
quantization. The cut-set bound of the relay chain network in 
this particular case, however, can be achieved to within half a bit 
by a simple concatenation of a correlation-aware noisy network 
coding strategy and a decode-and-forward scheme. 

I. Introduction 

The capacity region of the Gaussian relay network has been 
open for decades. Recently, the capacities of several relay 
networks with simple structures have been approximated to 
within constant number of bits. For example, for the three- 
node Gaussian relay channel, Avestimehr and Tse [ 1 ] showed 
that the decode-and-forward strategy achieves to within half a 
bit of the capacity; Chang, Chung, and Lee Q proved that the 
compress-and-forward rate is within half a bit of the capacity, 
and the amplify-and-forward rate is within one bit. 

In their breakthrough work, Avestimehr and Tse |1| fur- 
ther showed that, the capacity of the single-source single- 
destination Gaussian relay network in general can be achieved 
to within constant bits via a universal relaying scheme called 
quantize-map-and-forward (QMF). They also showed that, the 
gap to capacity is only related to the number of nodes in the 
network. 

Parallel to Avestimehr and Tse's work, Lim, Kim, El Gamal, 
and Chung [3J proposed a noisy network coding strategy 
that naturally extends the conventional compress-and-forward 
scheme of Cover and El Gamal [4| and the classic network 
coding by Ahlswede, Cai, Li, and Yeung |5 1 to noisy networks. 
The main idea of noisy network coding is to derive an explicit 
expression of the achievable rate for each cut-set of the 
network. Then, by comparing with the cut-set upper bound, 
noisy network coding can be shown to achieve to within 
constant gap to the capacity of general multisource multicast 
Gaussian networks. 

A key assumption made in both |[T| and Q is that the 
noises in the Gaussian relay network are independent with 
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Fig. 1. A four-node Gaussian relay chain network 



each other This assumption may not hold in practical systems, 
where common interferences from other sources play a role. In 
this paper, we are interested in the following question. In the 
context of Gaussian relay networks with correlated noises, can 
noisy network coding achieve within constant bits to the ca- 
pacity as well? This paper gives a negative answer by studying 
a four-node Gaussian chain network with correlated noises. It 
is shown that, in a certain scenario, the noisy-network-coding 
rate (with Gaussian input and Gaussian quantization) has an 
unbounded gap to the cut-set bound, whereas a concatenation 
of a modified correlation-aware noisy network coding strategy 
and a conventional decode-and-forward scheme achieves to 
within half a bit of the cut-set bound in this specific case. 

II. Channel Model 

The four-node Gaussian relay chain, as depicted in Fig. [T] 
consists of a source node, a destination node, and two relay 
nodes. The source communicates with the destination with 
the help from the two relays in between. Information passes 
from the source to the neighboring relay, and to the next, then 
finally to the destination. The input-output relationship can be 
described as follows: 



Y2 = h2Xi 
Y3 ~ ^3X2 



Zi, 

-Z2, 
-Z3. 



Without loss of generality, assume that the transmit power 
of all nodes are normalized to one, and the variances of the 
receiver noises are also normalized to one, i.e., Zi ^ Af{0, 1). 
The receiver noises are i.i.d. in time, but the noises [Zi, Z2, Z3] 
are correlated with the following correlation matrix: 

1 P12 P13 
Kz = P12 1 P23 

_ Pl3 P23 1 

where is positive semidefinite and pij is the correlation 
coefficient between Zi and Zj. Note that the relay operation 
must be causal in time. 



III. SUBOPTIMALITY OF THE NOISY NETWORK CODING 

We begin by showing that using noisy network coding with 
the choices of Gaussian inputs and Gaussian quantization 
noises, the gap between the achievable rate and the cut-set 
bound can be unbounded for a Gaussian relay chain network 
with a certain noise correlation structure. First, an upper bound 
to the cut-set bound of the four-node relay chain can be 
computed as follows: 

max mm{I{X; Yiy2i"3|^i^2), /(^^i; ^2^31X3), 

p{x,Xi,X-2) 

I{XX,X2;Y3),I{XX2;Y^Y3\X^)} 
< min{max /(X ; Yi Y2 | ^1 ^2 ) , max /(XXi ; Fa >3 1 ^2 ) , 

max / (XXi X2 ; Fa ) , max ; n I ^1 ) } 

= mm{C{Si),C{S2),C{S3),CiSi)} 
= C (1) 

where the cut-sets are defined as Si = {X}, S2 = {X,Xi}, 
S3 = {X,Xi,X2}, and 54 = {X,X2}, and C{S,),i = 
1,2,3,4 are the four cut-set upper bounds, which can be 
calculated as 



for all cutsets S C [I : N] with S*^ n 2? 7^ 0, where R{S) = 

Although the quantization in the above noisy network 
coding theorem can in theory have arbitrary distributions, 
Gaussian inputs and Gaussian quantization noises are usually 
adopted for Gaussian networks [?] 1*6], and are shown to 
achieve constant gap to capacity for networks with uncorre- 
cted noises |3J. Thus, this paper follows the same choice, 
i.e.. 



Y^Y 



(7) 



where the quantization noise Zi ^ Af{Q,qi) is independent 
with everything else. Now applying the noisy network cod- 
ing theorem with Gaussian inputs and Gaussian quantization 
noises, the following achievable rates for cut-sets Si, S2, and 
53 can be derived: 



and 
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which is redundant. 

The main point of noisy network coding is that an achiev- 
able rate can be derived for each of the cut-sets iSi, iS2, and 53 
using a generalization of the compress-and-forward scheme. 
For convenience, we state the achievable rates as follows. 

Theorem 1 (Noisy Network Coding Theorem |]3|). Let V = 

Vi — I?2 = ••• = Vn. a rate tuple {Ri,--- , Rn) is 
achievable for the DMN p{y^\x^) if there exists some joint 
pmf P{Q)I\k=iPi^k\q)p{yk\yk,Xk,q) such that 

R{S) < min IiX{Sy,Y{S'),Yd\X{S'),Q) 

~IiY{Sy,YiS)\X^,YiS^),Yd,Q) (6) 
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and 

R{S2) 



1 + qi P12 Pi3 

P12 1 + q2 P23 

Pl3 P23 1 



(9) 



I{XXi;Y2Y3\X2) ~ IiYi;Yi\XXiX2Y2Y3[ 
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and 



I{XXiX2;Y3) - I{YiY2;YiY2\XXiX2Y3) 
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log(l + hi) 



4 log 
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ph 



qi P12 ~ P13P23 



P13P23 1 - P23 + q2 



qiq2 



(11) 



The achievable rate is then upper bounded by the minimum 
of the three: 



R<mm{R{Si),R{S2),R{S3)}. 



(12) 



Now, consider a special scenario when the noise Z3 is 
independent with both Zi and Z2, and channel strengths 
and scale with h^, i.e.. 
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(13) 
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This special setting gives us the following cut-set bounds: 



= C{S2) = C{S;) ^ I log (l + 
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and the following achievable rates for cut-sets Si to 
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Next, we show that, the gaps CiSi) - R{Si), C{S2) - 
R{S2), 0(83) — RiS^) cannot be made all finite when ~^ 
1. First, the gap on the cut-set Si is given by 



A(5i) 



CiSi) ~ RiSi) 



hi 
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log 1 



hi 



P12 

l+q2 



1 + qi 

and the gap on the cut-set ^2 is lower bounded by 

A(52) = C{S2)-R{S2) 



(16) 
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(17) 



and the gap on the cut-set ^3 is lower bounded by the same 
number as well, i.e.. 



A(53) 



> 



C{S^) - RiSs) 
1 , , qi +q2 

-log(^l + 

1, / 1 

- log 1 + - 
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qiq2 



Now, since 

C- 



i?>max{A(5i),A(52),A(53)}, 



(18) 



(19) 



in order to make C ~ R finite, all three gaps have to be upper 
bounded by a finite number. Inspecting the gap of A(5i) in 
( fTSj l, in order to make it finite when pi2 — > 00, both qi and q2 
have to go to zero. However, in this case, A (52) and A(iS3) 
are apparently unbounded. Therefore, in the scenario of ( fTS] ) 
and ( p^ , as goes to 1, it is impossible to keep all three 



gaps A(5i), A(52), and A(53) finite simultaneously. As a 
consequence, for the four-node Gaussian chain network with 
correlated noises, the noisy network coding achievable rate 
with the choice of Gaussian inputs and Gaussian quantization 
noises has an unbounded gap to the cut-set upper bound. 

IV. An Optimal Concatenated Scheme 

It is known that the cut-set upper bound is not always tight 
for the relay channel |7J, I^SJ, but for the four- node Gaussian 
chain network, does the cut-set bound have an infinite gap 
to capacity? Or, is it the noisy networking coding achievable 
rate that has an infinite gap to capacity? To answer this 
question, we show in the following that the cut-set bound 



(15 1 can actually be achieved to within half a bit for this 
four-node relay network with the particular noise correlation 
structure ( [T3| ) by a simple concatenation of a correlation-aware 
noisy network coding strategy and a conventional decode-and- 
forward scheme. This justifies the suboptimality of the noisy 
network coding for Gaussian relay networks with correlated 
noises. 

Inspecting the structure of the four-node relay network in 
Fig.[T]and the special correlation structure ( 13 1, it is easy to see 
that the last node is essentially independent of the first three 
nodes in this example. Now the first three nodes (from the 
source node X to the second relay node Y2) forms a three-node 
Gaussian relay channel, so we can apply the noisy network 
coding theorem just to the first three nodes. With the source 
message decoded at Y2, the second relay node can then re- 
encode the source information and forward to the destination 
13. With Yi serving as a noisy-network-coding type of relay 
and Y2 serving as a decode-and-forward type of relay, this is 
essentially a concatenation of the noisy network coding and 
the decode-and-forward scheme. The achievable rate of this 
concatenated scheme can be derived as follows. 

In the first relaying stage where Yi serves as a noisy- 
network-coding type of relay, according to the noisy network 
coding theorem |j3] Theorem 1], Y2 can decode the source 
message if the following rate is satisfied: 

R < mm{IiX,Xi;Y2)-I{Yi;Yi\X,Xi,Y2), 

I{X;Y2,Yi\Xi)}, (20) 

for some distribution 

p{x,xi,yi,yi) = p{x)p{xi)p{yi\x,xi)p{yi\xi,yi). 

Substituting Gaussian inputs X 7V(0, 1), Xi 7V(0, 1), 
and Gaussian quantization signal Yi = Yi + Zi, where Zi ^ 
Af{0,qi) is independent with everything else, we have the 
following achievable rate in the first stage: 

R < -in{ilog(l + ^ 



log 1 



qi 



i-p^2 



ilog(l + /i2)-ilog( 1 + 



1-P12 

qi 



(21) 



Next, with the source message decoded at Y2, the second 
relay node acts as a decode-and-forward type of relay, which 



re-encodes and forwards the source message to the destination 
Y3 through the Gaussian channel of channel gain h^. The 
destination can successfully decode the source message if 

R <llogil + hi). (22) 



Noisy network coding vs. Concatenated scheme 



Combining the above rate constraints (21 1 and (22 1 gives 



us the following achievable rate by the concatenated scheme: 
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log(l 4 
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Comparing the above achievable rate with the cut-set upper 
bound with pi2 and P23 set to zero: 



C = 



log 1 



hi 



P?2 



1 



log(l + /i^), 



log(l + hi) 



(24) 



we have the difference upper bounded by 



C-R < 



log 1 



qi 



1 



log 1 



qi 



(25) 

It is easy to see that the first term monotonically increases 
with qi while the second term monotonically decreases. As a 
result, to minimize the maximum of the two terms, we need 



1 



log 1 



1 



(26) 



2 V q^ / 2 "V i-pf2. 

which results in the optimal correlation-aware quantization 



level ql — Pl2- Substituting q^ into (25 1 gives us C - i? < 



^. Therefore, for the four-node Gaussian chain network as 
shown in Fig. [T] in the scenario where pi^ = P23 — 0, the 
cut-set upper bound can be achieved to within constant gap. 

Fig. |2] shows a numerical example for comparing noisy net- 
work coding and the concatenated scheme. In the simulation, 
we let hi — 20dB and all other channel parameters are set 
to satisfy ( pj) and ( [T4| . For the quantization parameters, we 
choose the optimal quantization level qi = 1 — and let 
q2 = 1. As can be seen from the figure, when pi2 approaches 
to +1 or —1, both the cut-set upper bound and the achievable 
rate by the concatenated scheme go to infinity. However, the 
achievable rate by the noisy network coding scheme remains 
finite, making the gap to the cut-set bound unbounded. 

V. Conclusion 

This paper studies the optimality of the noisy network 
coding for a four-node Gaussian chain network with correlated 
noises. It is shown that, under a certain noise correlation 
structure, noisy network coding with Gaussian inputs and 
Gaussian quantization noises has an infinite gap to the cut-set 
upper bound. But, the upper bound can be achieved to within 
half a bit in this specific case by a simple concatenation of a 
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Fig. 2. Noisy network coding vs. concatenated sclieme 



correlation-aware noisy network coding strategy and a decode- 
and-forward scheme. 
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